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GRAPHICAL MESSAGE NOTIFICATION 

FIELD OF THE INVENTION 

The present invention relates generally to 
messaging systems, and more particularly, to a method, 
apparatus and system for providing an addressee with 
graphical notification of a waiting message, and to a 
computer readable medium providing codes for directing a 
computer to provide same . 



BACKGROUND 

Electronic messaging systems, such as voice mail 
systems and email systems, have been widely adopted in most 

I =s i 

,]5 commercial and non- commercial arenas for storing and 

FU 15 retrieving digitized messages. Such messaging systems 
J=5 require a mechanism for notifying users of unreviewed 

€i messages. 

s Several methods of message notification are known 

jT! 2 0 in the art. In conventional voice messaging systems, for 
fjj instance, a subscriber may be notified that recorded 

§jf messages are awaiting the subscriber's review using one of 

^ a variety of notification schemes. In some messaging 

systems, a display light connected to a panel of a 

2 5 telephone may flash on and off to identify that recorded 

messages await retrieval. In other instances, subscribers 
of voice mail systems are notified that messages are 
awaiting review by way of an interrupted dial tone which is 
transmitted from the earpiece of a phone when the 

3 0 subscriber picks up the receiver. While such signalling 

techniques provide a user with notification of a waiting 
message, they do not provide the user with further 
information identifying the party that left the message or 
other information related to the source of the message. 



With digital display phones, a user subscribing 
to message waiting services receives a notification from 
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the voice messaging server when a message has been recorded 
for the user. The notification typically includes a signal 
which triggers the display of a predefined text message, 
such as "MSG", on the phone display. In a number of 
5 display phones, a series of ASCII text characters are 
transmitted to the display phone and are displayed to 
notify the subscribing user of the pending messages within 
the user's voice mail, although in such cases, the 
information provided is limited to textual information 
10 identifying the caller name and/or number associated with 
a recorded message. 

In other messaging systems, such as electronic 
mail (email) systems, users may log into their email 
accounts and download stored email. If messages are 
received locally, a single line of text typically 
identifying the sender's name, the date the message was 
received and the title of the message are displayed in a 
viewing window within the email application. In systems 
such as HotMail (TM) and Yahoo (TM) mail services, users 
connect remotely over the Internet to review email on web 
pages which present the user with a viewing window 
containing the aforementioned textual message information 
similar to locally managed email applications. In other 
cases, PC messaging servers such as Microsoft Exchange (TM) 
flash a small icon in the bottom of the user's screen to 
alert the user that a message has arrived but do not 
provide any indication as to who has sent the message. 

30 Although the provision of textual information 

associated with a notification of waiting messages can 
provide the user with some information pertaining to the 
waiting messages, it would be desirable to deploy message 
waiting notification services which facilitate the ease of 

35 identifying the source of a recorded message with graphical 
images. It would be particularly desirable that message 
waiting notification systems provide graphical 
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notif ications to a called party including caller selected 
graphical images associated with the caller for display at 
the called party's end-user communications equipment. 



5 As will be further appreciated, the continuing 

convergence of most forms of user traffic has spawned a 
growing demand for telephony messaging systems and other 
user messaging systems that offer communications services 
which leverage the opportunities presented by integrating 
10 telephony and data network infrastructures. In such a 
converging telecommunications market, it would be desirable 
that a method of graphically notifying a user of waiting 
messages have application to a number of communications 
networks, including telephony and data networks. 

15 

SUMMARY OF THE INVENTION 

The above problems are addressed by providing an 
addressee of a stored message with a graphical notification 
associated with the stored message, including presenting 
20 the addressee with an information signal relating the 
stored message to at least one graphical image associated 
with the source of the stored message. 

In accordance with one aspect of the invention, 
25 there is provided a method of indicating the source of the 
stored message to the addressee. In this aspect, an 
information signal is generated relating the stored message 
to at least one graphical image associated with the source 
of the stored message, and the information signal is 
30 transmitted to a communications device associated with the 
addressee. In this case, a representation of the one or 
more graphical images may be included in the information 
signal. Alternatively, the information signal may include 
a network address identifying a location where the 
35 graphical images associated with the source may be 
accessed, directly or indirectly, by the addressee. Such 
a network location may refer to any of a variety of 
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networked resources. For instance, the network location 
may refer to the location of a messaging system associated 
with the source, the location of another network resource 
associated with the source such as a web page, or the 
5 location of an end-user communications device associated 
with the source. 

The flexibility available in identifying a 
network location from which graphical images associated 

10 with the source of the stored message may be accessed 
extends further flexibility to the manner by which 
graphical notifications such as the information signal and 
the graphical image associated therewith may be retrieved 
and presented to the addressee's communications device. 

15 For instance, in one embodiment a request for pending 
notifications may be received by a messaging system from 
the addressee. In this embodiment, if there are any 
pending notifications for the addressee, they are retrieved 
and transmitted as information signals to the addressee's 

2 0 communications device. In the case where such a 

notification includes a network location, the addressee's 
communications device may be prompted by the arriving 
information signal to connect with the appropriate 
networked resources associated with the network location so 
25 as to retrieve the one or more graphical images associated 
with the source . 

In a preferred embodiment, the communications 
device of the addressee is alerted that an incoming message 

3 0 from the source is being stored and the communications 

device is permitted to interrupt the storage of the 
incoming message and connect with the source. This 
mechanism provides a called party with the flexibility to 
connect with a communication from the calling party even 
3 5 when the calling party is recording a message for the 
called party. 
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In another preferred embodiment, graphical image 
information associated with the called party is retrieved 
and presented to the calling party when the calling party 
initiates a communication. 

5 

In another embodiment, once a message is stored, 
a graphical image associated with the source and pre- 
selected by the source is related to the stored message, 
giving the user the flexibility to arrange for graphical 
10 images to be presented in communications according to the 
type of communication and the class of recipient. 

In yet another embodiment, the information signal 
may prompt the communications device of the addressee to 

15 connect with a networked resource associated with the 
network location, such as a web server application located 
on a network server, so as to retrieve a web page 
identifying one or more new graphical notifications from 
one or more sources. For instance, information encoded 

2 0 within the information signal received by an addressee may 
prompt the addressee's communication device to launch a web 
browser connecting the addressee to a web page from which 
pending graphical notifications are available to the 
addressee for review and for retrieval of associated stored 

2 5 messages. 

Preferably, the method includes determining the 
source of the stored message so as to support various 
identification mechanisms. For instance, in one embodiment 
30 the method includes determining caller line identification 
information associated with the stored message, thereby 
offering the advantage of associating graphical 
notifications with subscribers of a messaging system that 
are identified by way of such caller line identification 

3 5 information. 



• • • 
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In another embodiment the method includes 
determining a calling party associated with the stored 
message. This latter embodiment has the advantage of 
graphically identifying a calling party associated with a 
5 stored message independent of the subscribing 
communications line from which the stored message 
originated. 

In one preferred embodiment, the method includes 
10 identifying a media type of the stored message and 
presenting a graphical image associated with the media type 
to the communications device of the addressee. In this 
embodiment, the addressee can be presented with both at 
least one graphical image associated with a calling party 
15 and a digital representation of a graphical image 
associated with the media type of the stored message, 
offering within the notification to the addressee 
additional graphical information associated with the 
calling party or subscriber of the source communications 
20 line. 

In yet another embodiment, the method may include 
retrieving a digital representation of a sound waveform 
associated with the source and sending the digital 
25 representation of the sound waveform to the communications 
device of the addressee for presentation to the addressee 
along with an associated graphical notification. 

In another embodiment, a representation of at 
3 0 least one video frame from a stream of video data 
associated with the source is included in the information 
signal for presentation to the addressee. In a preferred 
embodiment, the one or more graphical images associated 
with the source of the stored message are reproduced from 
35 a video stream within the stored message itself so as to 
present the addressee with dynamically selected images of 
the calling party, irrespective of the subscriber 
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associated with the communications line from which the 
stored message was received. Advantageously, the captured 
video frames can be used to form a short video sequence for 
presentation to the addressee as part of the notification 
5 to the addressee of the stored message. Such a video 
sequence would preferably be associated with an audio track 
also captured from the stored message. 

In accordance with another aspect of the 
10 invention, there is provided an apparatus for performing 
the aforementioned method. In one embodiment, the 

apparatus includes a generator for generating a graphical 
notification relating the stored message to at least one 
graphical image associated wdth a source of the stored 
n=| 15 message. In this embodiment, the apparatus includes a 
g transmitter to transmit the graphical notification as an 

42 information signal to a communications device associated 

S! with the addressee. 

;r s 2 0 Preferably, the apparatus comprises application 

nj software for performing the aforementioned method and which 

is operative to reside on a networked computer server. In 
one embodiment, a network computer is programmed to present 
to subscribing addressees their stored messages or pending 
25 graphical notifications associated with such stored 
messages . 

In accordance with another aspect of the 
invention, there is provided a computer readable medium 

3 0 having codes for directing a network computer to (i) 
generate an information signal relating a stored message to 
at least one graphical image associated with a source of 
the stored message, and (ii) transmit the information 
signal to a communications device associated with an 

35 addressee of the stored message. 
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In accordance with yet another aspect of the 
invention, there is provided a system for performing the 
aforementioned method. In one embodiment the system 
includes a computer server operative to communicate with a 
5 database of information in which pending graphical 
notifications are stored and from which such notifications 
are retrieved by the computer server for presentation to a 
communications device of the addressee. 



10 In a preferred embodiment, the system includes an 

integrated messaging server featuring both message 
recording services and graphical notification services. 
The messaging server is interconnected to at least one data 
,n store such as a database storing messaging information 

y 15 including user profiles for subscribers of the messaging 
1=5 system, recorded messages associated with subscribers and 

'Q graphical message waiting notifications associated with the 

»J recorded messages of subscribers. Such messaging 

si information may be integrated into a single database 

{Ti 2 0 structure, segregated logically within the same server or 
ry segregated physically on separate computer servers. 

i^j User profiles may each provide one or more data 

structures for the management and provision of subscriber 

25 identification information and subscription services. In 
a centralized model, user profiles may include at least one 
data field relating a digital representation of at least 
one graphical image to the subscriber of the corresponding 
user profile. User profiles may also identify at least one 

3 0 recognized end-user communications device connected to the 
messaging network and capable of displaying graphical 
notifications associated with recorded messages available 
for review by the addressed subscriber. 



35 



When a message is recorded, the messaging server 
retrieves, directly or indirectly, information identifying 
the caller from the caller's user profile including 
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graphical image information associated with the caller. A 
graphical message notification associated with the recorded 
message is generated by the messaging server and stored. 
The messaging server preferably includes at least one 
5 process for monitoring network messages from subscribers 
and other messaging servers . 

In one embodiment, the messaging server retrieves 
and sends to a subscribing called party pending graphical 

10 notifications associated with stored messages from an 
appropriate database in response to a called party request 
for such information. In this embodiment, the end-user 
messaging software residing on an active subscriber 
communications terminal logs -on with the messaging server. 

15 Alternatively, the end-user messaging software may direct 
the user terminal to periodically poll the messaging server 
for pending notifications. In another embodiment, the 
messaging server polls recognized end-user communications 
terminals to determine if any are active to receive pending 

20 notifications. Communications may be established with 
active terminals associated with pending graphical 
notifications, and the latter notifications may then be 
sent to the appropriate active terminals for display. 

25 The single messaging server embodiment 

advantageously provides a unified model, with both callers 
and called parties being subscribers of the same messaging 
server system capable of supporting fully compatible data 
structures for both caller and called party profiles, 

30 messaging data and notification data, and which reduces the 
need for intermediary gateways between caller and called 
party domains. In one variation of this embodiment, 
graphical notification services can be provided to a called 
party in respect of a recorded message from a remote caller 

35 located on another interconnected network or subnetwork. 



In another embodiment, message recording services 
and graphical message waiting notification services may be 
segregated logically within the same server domain, or on 
separate computer servers interconnected locally or 
5 remotely over a network, thereby facilitating additional 
flexibility in the provision of the graphical notification 
services with existing and expanding networks. In 
addition, callers and called parties may be located on 
separate interconnected networks or subnetworks . 

10 

In accordance with another aspect of the 
invention, at least one intermediary web server may be 
provided which is interconnected to at least one called 
party messaging notification system. In this web-based 

15 embodiment, the messaging server may preferably send copies 
of pending graphical notifications to a web server for 
allocation to a web page associated with the called party. 
Once the pending graphical notification is delivered to the 
server, either the messaging server or the web server may 

2 0 notify a recognized active terminal associated with the 
called party of the pending notifications available at the 
web page or web server. Preferably, a called party's 
active terminal is prompted to retrieve the new web 
content, including the pending graphical notifications, for 

2 5 display on a network communications device such as a 

computer terminal. This may include transmitting a message 
from the web server for instructing the active terminal to 
launch a web browser, if available, to pull down the web 
page from a predefined web resource. 

30 

Other aspects and features of the present 
invention will become apparent to those ordinarily skilled 
in the art upon review of the following description of 
specific embodiments of the invention in conjunction with 

3 5 the accompanying drawings. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

In the accompanying drawings which illustrate 
embodiments of the invention, 

5 FIG. 1 is a schematic diagram of a graphical message 
waiting notification system within a networked 
environment according to a first embodiment of 
the invention; 

10 FIG. 2 is a schematic representation of a data structure 

for user profiles accessed by messaging server 
software of the graphical message waiting 
^ notification system of FIG. 1; 

=n 

y . 15 FIG. 3 is a schematic representation of a data structure 
j*^ accessed by a messaging system for storing 

^13 message profiles in accordance with the first 

j5[ embodiment of the present invention; 

:Ij 2 0 FIG. 4 is a schematic representation of another data 
jlj structure accessed by a messaging system for 

4* providing graphical message notification in 

accordance with the first embodiment of the 

present invention; 

25 

FIG. 5 is a block diagram of the graphical message 
waiting notification system shown in FIG. 1; 

FIG. 6 is a block diagram illustrating layering of 

30 communication functions of the graphical message 

waiting notification system shown in FIG. 1; 

FIG. 7 is a block diagram illustrating a called party's 
end-user communications device of the graphical 
35 message waiting notification system shown in FIG. 

1; 
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is a flow diagram illustrating the operation of 
a graphical message waiting notification system 
including the operation of the system of the 
first embodiment shown in FIG. 1/ 

is a flow diagram illustrating the monitoring 
operations carried out by a computer server at 
the direction of messaging server software in 
accordance with the first embodiment of the 
invention in FIG. 1; 

is a block diagram of a graphical message waiting 
notification system including a web notification 
server in accordance with a second embodiment of 
the invention; 

is a flow diagram illustrating the operation of 
various graphical message waiting notification 
services in accordance with the second embodiment 
of the invention in FIG. 10; 

is a block diagram of a first network 
architecture implementing a communications system 
according to a third embodiment of the invention; 

is a flow diagram of operations executed by 
network resources of the embodiments shown in 
FIG. 12 or 17 to achieve graphical caller 
identification over a data network; 

is an expanded view of a lookup table shown in 
FIG. 12; 

and 16 

illustrate HTTP messages transmitted by network 
resources in the network architectures shown in 
FIG. 12 and 17; and 
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FIG. 17 is a block diagram of a second network 
architecture according to a fourth embodiment of 
the invention. 



5 It will be appreciated that for simplicity and 

clarity of illustration, elements illustrated in the 
accompanying drawings have not necessarily been drawn to 
scale. For example, the dimensions of some of the elements 
are exaggerated relative to other elements for clarity. 
10 Further, where considered appropriate, reference numerals 
and labels have been repeated among the drawings to 
indicate corresponding or analogous elements. Where also 
considered appropriate, descriptive tags defined in the 
specification have been repeated herein. 

15 

DETAILED DESCRIPTION 

In the present invention there is provided a 
method, apparatus and system for providing an addressee of 
a stored message with a graphical notification associated 
2 0 with a source of the stored message. In general terms, a 
communications device of the addressee is presented with 
the graphical notification in the form of an information 
signal which relates the stored message to at least one 
graphical image associated with the source of the stored 

2 5 message. 

Referring to FIG. 1, a graphical message waiting 
notification system according to a first embodiment of the 
invention is shown generally at 10 (also referred to 

3 0 herein, for ease of reference, as graphical notification 

system 10) . For the purposes of the illustrative 

embodiment of FIG. 1, graphical notification system 10 
includes an integrated messaging server system which 
provides voice messaging and graphical message notification 
3 5 services to subscribing users over network 12. However, a 
voice messaging system (or such other message acquisition 
services) may be separately associated with graphical 
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notification system 10, provided graphical notification 
system 10 includes graphical message notification services 
relating messages stored in the voice messaging system to 
graphical notifications associated with the source (s) of 
5 such stored messages . 

As noted above, system 10 is a "graphical" 
notification system. Although, in general, the term 
"graphical" may have several different meanings depending 

10 upon the context, persons skilled in the art will 
appreciate that in this specification, the terms "graphic", 
"graphical", "graphically", "graphical information", 
"graphical image" and the like are each used to refer to 
(as well as refer to the use of) computer graphics, and 

15 more particularly to one or more digital (or digitized) 
pictures, photos, icons, and/or video frames (with or 
without audio data) , for display on a display device such 
as a monitor, a liquid crystal display (LCD) , a digital 
screen or other electronic display device capable of 

2 0 displaying computer graphics. The terms "text" and 

"textual information", on the other hand, are used in this 
specification to refer to information selected from a 
binary-coded character set consisting of one or more 
letters, numbers and/or other typographic symbols. 
25 Examples of binary-coded character sets include ASCII, 
EBCDIC and BCD. 

In the embodiment shown in FIG. 1, the graphical 
notification system 10 is connected to network 12 which 

3 0 interconnects with other communications devices such as 

source terminal device 14 and destination terminal device 
16. Network 12 is, for purposes of illustration, an 
Ethernet -based local area network (LAN) . Terminal devices 
14 and 16 represent end-user communications devices which 
3 5 each either include, or are connected in communication 
with, a display device for the display of graphical 
information transported over network 12 . 
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As an overview, graphical notification system 10 
provides a mechanism for graphically notifying an 
addressee, via an end-user communication device having 
graphical display capabilities, of waiting messages stored 
within message database 20 (or accessible from a separate 
messaging system associated with system 10) . When a 
communication is initiated by a source connected to network 
12, such as source terminal device 14, the source attempts 
to make a connection with the addressee of the 
communication at destination device 16, either directly or 
indirectly via graphical notification system 10 or another 
network resource supporting such communication. 

If the source cannot connect with the addressee 
within a predetermined period of time, the source is 
directed by graphical notification system 10 to the message 
recording services provided by system 10 if such services 
are available to the addressee. When a message from the 
source is recorded for the addressee, the graphical 
notification system 10 retrieves graphical information 
associated with the source so as to form a graphical 
notification identifying the source. To this end, 

graphical notification system 10 generates an information 
signal relating the stored message to at least one 
graphical image associated with the source of the stored 
message. The information signal is transmitted by 
graphical notification system 10 to the addressee's 
destination terminal device 16 via network 12 preferably in 
response to a request for pending notifications from the 
addressee received by system 10 . 

For the purposes of illustration, a communication 
from a source to an addressee is discussed below in the 
context of a telephone call from a calling party to a 
called party. It will be appreciated, however, that a 
communication in the context of the present invention may 
also include communications involving other media types 
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such as a cell phone transmission, a pager message, a fax 
communication, an audio/video communication such as a video 
conference call over a data network, a voice call over IP, 
or an electronic mail (email) transmission (of arbitrary 
5 media, e.g. voice, graphics, video, text or combinations 
thereof) . As well, the source associated with a stored 
message may be identified either by association with a 
subscriber of the caller line from which the stored message 
originated or an identifier associated with the source such 
10 as a user ID or a calling party ID. 

It will also be appreciated by persons skilled in 
the art that network 12 can be any one of a variety of 
network infrastructures. For instance, network 12 may be 
another type of LAN, such as a Token-ring LAN or a carrier 
sense multiple access with carrier detection (CSMA/CD) LAN. 
Alternatively, or in addition, network 12 may include a 
wide area network (WAN) deployed using a network topology 
such as X.25, frame relay, asynchronous transfer mode (ATM) 
or synchronous optical network/synchronous digital 
hierarchy (SONET/SDH) , or internetworked combinations 
thereof. Network 12 may alternatively be a circuit 
switched network, such as a public switched telephone 
network (PSTN) or a privately leased switched network (such 
as a Tl , El, T3 or E3 circuit switched network) . In any 
combination of the above network topologies, network 12 may 
be a public network, a private network or intranet, or part 
of the Internet . 

3 0 Furthermore, while graphical notification system 

10 is discussed in the context of a voice messaging system, 
graphical notification system 10 may in other embodiments 
include, in the alternative or in addition, other messaging 
services such as audio/video messaging, fax messaging or 

35 email messaging. Similarly, terminal devices 14 and 16 may 
include one or several different types of (end-user) 
communications devices, such as network computer terminals, 
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networked personal computers, network display telephones, 
telephones optionally connected to associated personal 
computers (PCs) , public display telephones, or wireless 
communications devices such as mobile telephones connected 
5 over a wireless network, provided such communications 
devices include, or are connected to, a display device so 
that graphical notification information may be received by 
the terminal device and graphically displayed on the 
display device, preferably along with other information 
10 such as the calling number, the date and time of the 
associated message and the caller name. 

Referring to FIG. 1 and 2, subscribing users of 
graphical notification system 10 are each allocated a user 

15 profile 30 which is stored within the user profile database 
18. Each user profile 30 provides one or more data 
structures for the management and provision of user 
identification information and subscription services. User 
profile 30 includes a graphical data field 44 related to a 

2 0 digital representation of at least one graphical image 
associated with the user corresponding to the user profile. 
Graphical data field 44 may include either a reference to 
one or more graphical images, or digital representations of 
such graphical images. As will be seen below, when a 

2 5 subscribing caller records a message for a subscribing 
called party, the caller's graphical image data is accessed 
by graphical notification system 10 and appended to 
graphical notification message 60 which is stored in memory 
allocated to the called party within a message notification 

30 database 22 for subsequent retrieval and presentation to 
the called party. 

User profile 30 may include a variety of other 
fields. For instance, for a subscriber of a voice 
35 messaging system, user profile 30 preferably is structured 
to include the subscriber's phone number, name and address 
information, and recorded greetings in fields 32, 34, and 
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36, respectively. Preferably, user profiles are used for 
calling subscribers and called subscribers. Furthermore, 
user profile 30 may include a graphical identification 
field 42 to support the provision of different classes of 
graphical information. For instance, graphical images may 
be digital representations categorized as single images, 
digital video frames, one or more graphical icons or 
digital audio/video data. Supporting a variety of classes 
of graphical information has the advantage of extending the 
functionality of graphical notification system 10 to 
provide a more flexible range of services to subscribers 
who may have different classes of end-user display devices. 

As another variation, user profile 30 may include 
a field 38 identifying the type of end-user communications 
device registered with the voice messaging system. This 
latter arrangement provides graphical notification system 
10 with the capacity to readily determine which services a 
subscribing user' s communication device is capable of 
handling. This can be of advantage when system 10 supports 
a variety of different classes of graphical information 
since not all end-user communications devices may support 
all types of graphical information. Recording a 

subscriber' s type of communication device within the user 
profile facilitates the advanced determination by system 10 
of what graphical data of a caller is suitable to present 
to the called party's display device. 

User profile 3 0 may also include address 
information for a variety of subscriber devices as 
exemplified by field 40, so as to provide graphical 
notification system 20 further flexibility in notifying an 
addressee via one or more devices identified within field 
40. For the illustrative embodiment shown in FIG. 1 and 2, 
terminals 14 and 16 include a telephone set and a personal 
computer which are co-located at a user' s workstation and 
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are registered in user profile database 18, using fields 38 
and 40, as belonging to associated subscribers. 

In the embodiment illustrated in FIG. 1 and 2, 
5 user profile 3 0 is also shown having an index 4 6 to the 
user's recorded/waiting messages received by graphical 
notification system 10. It will nevertheless be 

appreciated that a user's recorded messages may be 
referenced in one of many different ways. By way of 
10 example, the recorded messages may be stored directly as 
part of user profile 30. Alternatively, the recorded 
messages may be cross-referenced in a separate table cross- 
referencing users with such messages, rather than having an 
index within user profile 30. 

15 

Referring to FIG. 1 and 3, a received message is 
allocated by graphical notification system 10 to a message 
profile defined by a data structure 50. Message profiles 
for a called party are stored within message database 20 

20 for subsequent retrieval and presentation upon the called 
party requesting the corresponding recorded message from 
graphical notification system 10. As illustrated by 
message data structure 50, each message profile includes a 
field 58 for the caller's recorded message as well as 

25 message identification fields 52 for storing caller line ID 
data such as the caller's telephone number and name. Other 
fields 54 and 56 may also be provided for recording 
information such as the time and date the associated 
message was recorded, the message length or duration, the 

3 0 reviewed status of the message, the priority of the 
message, and addressing information identifying, for 
example, a list of other recipients of the recorded 
message . 

3 5 When a message is received from a caller and 

recorded, graphical notification system 10 retrieves 
information identifying the caller from the caller's user 
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25 
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FIG 5, there is shown a more 
Referrxng to FKK . system 10 

detailed representatxon of 9™*£" As ghown tn FIG . 5, 
from the first embodiment xn - ^ ^ server 
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wnich is directly or xndxrect y meS saging 



example , computer server 7 0 may be a Reduced Instruction 
Set Computing (RISC) device such as a Sun Microsystems 
UltraSparc (TM) Station or an IBM RS/6000 (TM) , or a personal 
computer suitable for hosting messaging services such as a 
Compaq Proliant (TM) or an IBM NetFinity (TM) server. 
Preferably, computer server 70 is scalable to the needs of 
graphical notification system 10 as the number of 
subscribers increases . 

As illustrated in FIG. 5, memory 72 provides a 
memory store for software and data residing on computer 
server 70 such as messaging server software 74, 
communications suite 76 and operating system 78. Memory 72 
also stores data 71 for remote or local retrieval and other 
applications 73. Operating system 78 is preferably a 
multitasking operating system such as Unix, Linux, 
Microsoft Windows NT(TM), Sun Solaris (TM) or IBM AIX(TM). 
Communications suite 7 6 includes software providing 
transport and routing communication protocols as well as 
network interface software for enabling communications 
between users over network 12 (FIG. 1) . Preferably, 
communications suite 76 includes the well known and 
ubiquitous TCP/IP suite of services, although other 
communications protocols, such as those adhering to the 
Open Systems Interconnection (OSI) reference model in the 
International Standards Organization (ISO) standard 7498, 
or layered arrangements which make use of TCP or IP with 
other available protocols, may be used in the alternative, 
so long as such communications suites are sufficient to 
provide a networked environment for use of the graphical 
message waiting notification system contemplated herein. 

Referring to FIG. 6, there is shown an example of 
the layering of communications functions in the present 
invention using the TCP/IP suite. As is known in the art, 
the Internet Protocol (IP) is a widely used connectionless 
routing protocol, similar to the connectionless network 
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protocol (CNLP) specified in ISO 8473, and serves as the 
foundation for routing over a variety of networks, 
including the Internet . Connection-oriented services can 
be, and often are, provided over the IP protocol using a 
5 higher layer transport protocol such as the Transmission 
Control Protocol (TCP) . TCP is a connection-oriented, 
packet -switching protocol used for communications between 
processes in host computers and connected users . TCP 
maintains status and state information about each user data 
10 stream flowing into and out of the associated TCP software 
module. The TCP protocol also provides end-to-end data 
transfer across one network or multiple networks to a 
higher layer protocol or application at a destination 

,g resource. In the TCP/IP model in FIG. 6, communications at 

15 the network layer between computer server 7 0 and network 12 

^ are handled by the network interface which in the 

'5 illustrative embodiment in FIG. 1 implements the IEEE 802.3 

»i ethernet standard. 

;7! 2 0 Referring to FIG. 5 and 6, messaging server 

nj software 74 is an application layer entity which preferably 

resides on computer server 7 0 in memory 72 and executes on 
central processor 80 of computer server 70. Messaging 
server software 74 comprises computer readable codes which 
2 5 program computer server 70 to provide voice messaging 
services and graphical message waiting notification 
services. It will be appreciated, however, that voice 
messaging services and graphical message waiting 
notification services may be provided in sets of codes 
30 within two or more interoperable software applications 
running on the same computer server 7 0 or several connected 
computer servers . 

Messaging server software 74 directs computer 
35 server 70 to communicate with user profile database 18, 
message database 20 and message notification database 22 
optionally via network interface 84 connected to private 



= ! i 



-23- 

LAN 85. Databases 18, 20 and 22 may reside in one or more 
memory stores, preferably including at least one permanent 
storage device such as a hard disk drive, located on 
computer server 70 or on separate server computers 
5 networked in communication with computer server 70. The 
messaging server software 74 uses the user profile database 
18, message database 20 and the message notification 
database 22 which serve as data stores for the management 
and provision of message and user information within 
10 graphical notification system 10. 

Also included in the graphical notification 
system 10 there is provided image administration software 
application 86 which comprises codes which may reside on 
15 and be processed by a separate computer 88 connected via a 
network interface 90 to the computer server 70 so as to 
reduce the amount of administrative load on computer server 
70. The image administration software 86 provides services 
for the receipt and storage of digital representations of 

2 0 one or more graphical images associated with subscribers of 

graphical notification system 10. Preferably, image 
administration software 86 includes commercially available 
software such as Adobe Photoshop (TM) which may be used to 
direct computer 88 to handle the resizing of graphical 
25 images to preset sizes suitable for end-user display 
devices. Computer 88 is preferably capable of handling the 
reception of such images locally via a disk drive 87 or 
other local input device such as a scanner connected to a 
Universal Serial Bus, or from subscribers on a secured 

3 0 basis over network 12 (FIG. 1) using, for instance, remote 

access software such as PC Anywhere (TM) . Graphical images 
received by computer 88 may be stored in user profile 
database 18 or another connected database, thereby 
facilitating the ability of system administrators and 
35 subscribers (where suitable) to add to, delete from or 
otherwise modify graphical images within their user 
profiles . 
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Ref erring to FIG. 7, there is shown a schematic 
diagram of end-user communication device 100, exemplified 
earlier by terminal devices 14 and 16 (see FIG. 1) . 
Communication device 100 includes central processor unit 
5 102 connected to: memory 104, display 122 (via display 
interface 120) , user input device 126 (via user input 
interface 124), and network interface 130. Central 
processor 102 performs the operations necessary to connect 
communications device 100 to a network via network 
10 interface 13 0 and is programmed by terminal messaging 
software 112 to receive and display graphical message 
notifications in the form of incoming information signals 
associated with stored messages on display 122 . By way of 
JJ5 example, processor 102 can be selected from the Intel x86 

|]J 15 chipset, Intel Pentium (TM) series, Motorola PowerPC (TM) or 
G3 series, or another suitable processor. Data, such as 
graphical message notifications, which are to be displayed 
I=; by communications device 100 are transmitted by processor 

» 102 to display device 122 which may be any type of display 

j!" 20 supporting the display of graphical images. Memory 104 is 
|ij preferably comprised of volatile memory such as Random 

^3 Access Memory (RAM) , and non-volatile memory such as a hard 

m disk drive or Read Only Memory (ROM) . 

25 As illustrated in FIG. 7, memory 104 may contain 

a variety of software programs, including an operating 
system 116, communications suite 114, and terminal 
messaging software 112 . The operating system 116 may be 
selected from a variety of operating systems and preferably 

30 provides a graphical user interface (GUI) such as in 
Microsoft Windows 98 (TM) , Windows CE (TM) or Macintosh 
Operating System 8 (TM) . It will be appreciated, however, 
that operating system 116 is by no means limited to more 
robust operating systems. In fact, for more specifically 

35 tasked end-user communications devices, such as 
computerized display phones, a more simplified operating 
system such as pSOS, available from Integrated Systems 
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Inc . , is preferred. Communications suite 114 may include 
TCP/IP, Point-to-Point Protocol (PPP) , or SLIP, as well as 
Ethernet or Token Ring software protocols for network 
communication via network interface 130. It will be 
5 appreciated, however, that communications device 100 may 
alternatively interface with a network via a wireless LAN 
or other wireless data network equipment, or via a cable or 
Asymmetric Digital Subscriber Line (ADSL) modem or the 
like. For more fully featured end-user communications 

10 devices, such as with personal computers, lap- top 
computers, or palm- top computers, communications device 10 0 
preferably includes browser software 110, such as Netscape 
Navigator (TM) , Microsoft Internet Explorer (TM) , Mosaic (TM) 
or other commercially available browsers for connecting 

15 device 100 to the World Wide Web (WWW) and other IP based 
communications . 

Referring to FIG. 8, there is shown a flow 
diagram illustrating the notification services available 

20 with graphical notification system 10 for the embodiment in 
FIG. 1. For ease of reference in the following discussion, 
reference is made to FIG. 1 to 8 . In operation, a call is 
made by a caller from source terminal 14, to a subscribing 
called party at destination terminal 16, over network 12 

25 via graphical notification system 10. Preferably, 
messaging server software 74 is executed by processor 80 
and programs computer 7 0 to monitor for subscriber requests 
over a network interface to network 12 at step 14 8. When 
a call from the caller is received by computer server 70, 

30 the call is directed by messaging server software 74 at 
step 150 to the called party' s destination terminal 16 
using the called party's address information stored in user 
profile database 18. If the call is answered at step 152 
communication between the caller and called party proceeds 

3 5 at step 154 in the usual way available over the network 
until it is terminated by one of the parties. If, on the 
other hand, the called party does not answer the caller's 
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call within a predetermined period of time, messaging 
server software 74 directs computer server 70 to query user 
profile database 18 at step 156 to determine if the called 
party is a subscriber of graphical messaging services. If 
5 computer server 7 0 determines that the called party is a 
subscriber of the messaging services of system 10, 
messaging server software 74 directs computer server 70 to 
retrieve the called party's recorded greeting from the 
corresponding user profile and to transmit the greeting to 

10 the caller at step 158, prompting the caller for a message. 
The caller's message is then recorded by computer server 70 
at the direction of messaging server software 74 at step 
160 and the caller's identification information including 
graphical data (if available and if the called party 

15 subscribes to the graphical service) is retrieved at step 
162 from the caller's user profile in user profile database 
18 . 

At step 164 messaging server software 74 directs 

20 computer server 70 to generate a graphical message waiting 
notification represented by an information signal which is 
associated with the recorded message from the caller and 
which includes a digital representation of at least one 
graphical image associated with the subscribing caller. In 

25 this way, messaging server software 74 directs computer 
server 70 to generate an information signal relating the 
stored message to the at least one graphical image . As a 
variation, if messaging server software 74 supports video 
or audio/video messaging, one or more frames of the 

3 0 recorded video or audio/video message may be reproduced 
within the graphical message waiting notification at the 
direction of messaging server software 74. Inserting into 
the notification live frames of video of the calling party 
offers the advantage of making available to the called 

35 party graphical images associated with the actual calling 
party, irrespective of the subscribing line, subscribing 
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connection or subscriber ID used by the calling party to 
send the recorded message. 

Computer server 70 stores the caller's recorded 
5 message with appended caller and call information (which in 
combination form the message profile) and the graphical 
message waiting notification at step 166 in message 
database 20 and graphical message notification database 22, 
respectively, and modifies the called party's user profile 

10 in user profile database 18 to record a reference to the 
newly recorded message and notification. Preferably, 
subscribers connect to computer server 70 via network 12 to 
retrieve pending notifications. Alternatively, pending 
notifications may be pushed to subscribers. For instance, 

15 if, at the direction of messaging server software 74, 
computer server 7 0 determines at step 168 that based on the 
called party's user profile a networked resource of the 
called party should be notified of the recorded message or 
graphical notification, computer server 70 proceeds to 

20 additional processing at step 210 (in FIG. 11) and 
otherwise preferably returns to monitoring for subscriber 
requests over network 12 at 148. 

The process of monitoring for user requests at 
25 step 148 of FIG. 8 by messaging server software 74 (FIG. 5) 
is decomposed into several operations in FIG. 9. For ease 
of reference, the decomposition of the monitoring process 
is described below with reference to FIG. 1 to 9. With 
TCP/IP communications, a client/server model is preferably 
3 0 implemented wherein a network- side server process running 
on computer server 70 with messaging server software 74 
monitors a first port for incoming requests and data from 
subscribers. A network-side client process also running on 
computer server 70 with messaging server software 74 is 
35 used to initiate transmissions to networked subscribers 
over a second port. At each networked subscriber terminal, 
a user- side server process running on such terminal with 
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the user-side terminal messaging software 112 monitors the 
second port for transmissions directed from the network- 
side client process via computer server 70. A user-side 
client process also running with the terminal messaging 
5 software 112 initiates transmissions and subscriber 
requests to the messaging server software 74 over the first 
port being monitored by the networked- side server process. 

When computer server 70 receives a request at 

10 step 190 (while monitoring at step 148) over network 12, 
messaging server software 74 directs computer 70 to parse 
the request. At step 192 messaging server software 74 
identifies the requestor (including the requestor's 
terminal address) and the subscription privileges of the 

15 requestor. This latter operation includes authenticating 
the requestor as a recognized subscriber of graphical 
notification system 10 and instructing computer server 70 
to query the user profile database 18 for information on 
the requestor's subscription services. For identified 

2 0 subscribers, messaging server software 74 determines at 
step 194 whether the request includes a request to retrieve 
one or more of the subscriber's recorded messages, a 
request to retrieve message notifications for the 
subscriber, or a request to connect a call. Requests to 

25 connect a call are handled by messaging server software 74 
at step 150 in the manner described above (in FIG. 8) . 
Requests for the retrieval of recorded messages are 
processed at the direction of messaging server software 74 
at step 196 wherein computer server 70 queries the message 

30 database 20 for the appropriate messages. Retrieved 
messages are sent by computer server 70 at step 19 8 using 
the TCP/IP protocol to the terminal address of the 
subscribing requestor. For requests identified at step 194 
as requests for message notifications, computer server 70 

35 determines at the direction of messaging server software 74 
whether or not the subscriber/requestor has subscribed to 
the graphical message services of graphical notification 
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system 10 at step 200. If the requestor is a subscriber of 
the graphical message services, messaging server software 
74 initiates at step 202 retrieval of pending graphical 
message notifications associated with the requestor from 
5 graphical notification database 22 . Retrieved graphical 
notifications are transmitted by computer server 70, at the 
direction of messaging server software 74, in the form of 
information signals to the terminal address of the 
subscribing requestor at step 206. For a subscriber that 
10 is a subscriber of notification services but not the 
graphical notification service, pending non-graphical 
message notifications associated with the requestor are 
retrieved at step 204 and sent to the subscriber at step 
206 . 

15 

Referring to FIG. 1 to 8, as an additional 
enhancement to graphical message waiting notification 
system 10, messaging server software 74 may optionally 
direct computer server 70 to query at step 180 (in FIG. 8) 

20 the caller's user profile in user profile database 18 to 
determine if the caller subscribes to called party 
identification services. If the caller is a subscriber to 
called party identification services, then computer server 
70 queries at step 182 the called party's user profile in 

25 user profile database 18 to determine if the called party 
has a graphical image associated with the called party. If 
a graphical image for the called party is found, and if 
computer server 70 can determine that the caller's terminal 
is capable of receiving such graphical information based on 

30 the caller's user profile (step 184), messaging server 
software 74 can direct computer server 7 0 to retrieve and 
transmit the graphical information to the caller's terminal 
for display (step 186) as the call is processed or a 
message recorded. In addition to providing the calling 

35 party with graphical information, textual information about 
the called party can be retrieved by computer server 7 0 at 
step 186 and communicated to the calling party's terminal 
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Ref erring to FIG. 11, there is shown in operation 
an illustrative embodiment of the web notification 
architecture described above with respect to FIG. 10. The 
operations of three network entities are shown in FIG. 11: 
5 (a) operations by computer server 70 with the direction of 
messaging server software 74, (b) operations carried out by- 
web server computer 207, and (c) operations carried out 
locally at a called party's terminal communications device. 
Referring to FIG. 8, 10 and 11, it will be recalled that 
10 when recording a message from a caller, messaging server 
software 74 may optionally determine at step 168 if the 
called party user profile stored in user profile database 
18 identifies any called party resource registered to 
35 receive notification of the recorded message or pending 

j]* 15 notification. In the web-based addition above, the called 
j=5 party' s user profile may include a field identifying web 

^13 server computer 207 or a similar web-based resource which 

Jii may be registered to receive notification information 

* (including graphical information associated with the caller 

;=1 2 0 if available) . In the case where the user profile 
_nj indicates that web server computer 2 07 is a registered 

Hi resource, messaging server software 74 directs computer 

m server 70 to retrieve from the called party' s user profile 

in user profile database 18 the location of a pre-selected 

2 5 web page on web server computer 2 07 associated with the 

called party and optionally the IP address of web server 
computer 207. Alternatively, the IP address of web server 
computer 2 07 can be a single, standardized location pre- 
programmed into computer server 70. 

30 

Once the requisite web page information is 
retrieved from the called party user profile, messaging 
server software 74 directs computer server 70 to establish 
a connection with web server computer 207, at step 210. If 

3 5 computer server 7 0 is programmed for telephony messaging 

services, such as a voice messaging computer operating at 
a central office or PBX equipment, then computer server 7 0 
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communicates with a telephone switch via a telephony- 
programming interface protocol such as Microsoft's 
Telephony API (TAPI) so as to control telephone sessions. 
As an alternative telephony interface, one may use Novell 
5 and AT&T's Telephony Services API (TSAPI) which is designed 
to enable a telephone PBX with a Netware (TM) server to 
provide interoperability between personal computers and 
telephone equipment. In such telephony environments, the 
telephone switch may be a PBX or Central Office for network 
10 configurations that use a telephone network to carry voice 
signals, or a gatekeeper or the like for configurations 
that use a Voice over IP protocol (such as specified in the 
H.323 Specification) to carry voice signals over data 
networks . 

15 

In operation, web server computer 2 07 may monitor 
its network interface with network 12 periodically at step 
22 6 for messages from computer 7 0 and from subscriber 
terminals. When a network connection request from computer 

20 server 70 is received by web server computer 207, the 
network request is verified and a confirmation may be 
transmitted back to computer server 70 (step 212) . 
Messaging server software 74 directs computer server 70 to 
send the new graphical notification information at step 214 

25 encapsulated in a network message to web server computer 
207 so as to add the graphical notification information to 
a web page associated with the called party (216) . By way 
of example, computer server 70 may send an HTTP message 
containing the IP address associated with the web server 

30 computer 207, the name of a server-side common gateway 
interface (CGI) script residing on web server computer 2 07 
and data and command parameters for configuring the server- 
side CGI script . 

35 At step 216, web server software 208 directs web 

computer server 2 07 to parse received network messages from 
computer server 70 and proceeds to modify the called 
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party's web page accordingly to include the new 
notification information. In the above HTTP messaging 
example, the server-side CGI script is executed by web 
server computer 2 07 so as to create or modify an HTML 
5 document and to populate the HTML document with the new 
notification information. Preferably, the server-side CGI 
script initiates a confirmation of the successful update 
which may then be sent by web server computer 2 07 to 
computer server 70 at step 218. When computer server 70 
10 receives the confirmation, it proceeds to update at step 
220 the called party's message notification records on 
database 22 to reflect the successful web- site update. 

Jf5 Optionally, other called party related records 

!"y 15 may be modified at step 220 such as the called party's user 
m profile located in database 18. Following modification of 

*0 the called party's web page with the graphical 

notification, computer server 70 may poll at step 222 one 
K or more registered called party end-user terminal devices 

;r! 20 to determine if the called party is connected. This latter 
llj operation offers the advantage of both pushing the updated 

~f web page graphical content to the called party's web site 

server and pushing another preferably brief notification 
directly to a networked end-user terminal to initiate 

2 5 retrieval by the active terminal of the modified web page 

from web server computer 207. For instance, at step 224, 
computer server 70 may send to the active end-user terminal 
a signal representing an ASCII string providing a Uniform 
Resource Locator (URL) to the called party's updated web 
30 page on web server computer 207. This string may be 
encapsulated within an HTTP message instructing the called 
party's active terminal to access the web server computer 
207 and the string itself may contain, as an access scheme 
to the called party's web page, another HTTP message making 

3 5 up part of the aforementioned URL. Of course, other access 

schemes may be implemented, including, for example, FTP and 
gopher . 
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messaging server, graphical message notification system 10 
may record a reference to the recorded messages in 
appropriate user profiles within the centralized 
identification database. Terminal messaging software 112 
5 on a user terminal periodically polls a messaging server, 
such as messaging server software 74 running on computer 
server 70, in search of new, unreviewed messages for a 
user. When such a message is detected, a reference to the 
message is added to a list of waiting messages. Terminal 

10 messaging software 112 then directs the terminal upon which 
software 112 resides to request graphical information 
associated with the source of the stored message from the 
centralized identification database. If such graphical 
information is found, it is used by messaging server 

15 software 74 to create a graphical message waiting 
notification for presentation via terminal messaging 
software 112 to the user to whom the message is addressed. 
Such a notification may be presented to the user as a 
business card with identification information pertaining to 

2 0 the source as well as information pertaining to the waiting 
message, such as the date and time the message was 
recorded. If the waiting message originated from a source 
that is not registered in the centralized identification 
database, a default graphic that denotes a call from an 

2 5 external source could be presented by messaging server 
software 74 to the user terminal for display along with 
textual identification information pertaining to the source 
and summary details regarding the stored message. The 
graphical message waiting notifications for such stored 

30 messages would be displayed on the user's terminal in, for 
example, a window of a graphical user interface or 
alternatively in a screen saver format for a dormant 
terminal . 
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Referring to FIG. 12, in another aspect of the 
invention, graphical information associated with a source 
or addressee of a communication is provided over a data 
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network to the other ^ inform ation associated 

aspect of the -nt^ £L*~ M is pro vided to an 

Wlth .rend user communications device via a 

addressee's end user commu nication from a 

or other network resource when end . user 

source is dxrecte ^ information associated 

communications devxce ided to the source of 
with the addressee may also Be P 
the communication. 

In the illustrative ^".^ 

; interconnected with called party dispiay 

user communications terminals 14 an ^ ^ 

devices. Web servers 250 and ^ ^ 

arrangement to web server compu er 207 (x ^ 

web server software reside may be web serve r 

0 caiied P-v; : — er servers within, or 
software residing on respecti * or gatek eepers. 

connected to, corresponding central office. 

•>« mav be arranged similar to 
Messaging system 265 may b ^ ^ ^ ^ ^ 

25 graphical notification system 10 s^ ^ 
to provide both messaging ^ 
notification services and, xn ^ Alt ernatively, 
graP hical caller identif icat.on services. ^ 

4-™ 9fi5 can comprise a yj-«f 
messaging system 265 c supp ort graphical 

30 -ntification ^^"^ ly Connected to a 
identification services ^ capable 

messaging server, such as a Q - rvice8 In whichever 

of providing message recording service ^ . ably 

.ariation is deployed -""^^ call P ed party 
provides both graphical caller 



identification. 



-42- 

Ref erring to FIG. 12 to 15, a caller located at 
terminal 14 initiates a call to a called party via a 
network connection 280 using the voice over IP (VoIP) 
protocol defined by the International Telecommunications 
5 Union (ITU) H.323 specification. It will be appreciated by 
persons skilled in the art that H.323 is an umbrella 
recommendation from the ITU which provides a foundation for 
multimedia communications including audio, video and data 
communications across IP based networks such as local area 
10 networks and the Internet. H.3 23 includes a number of 
standardized protocols for handling call set up, call 
control, media control, and real-time data exchange. 

The call (or call request) initiated from 
15 terminal 14 includes the IP address of the called party' s 
service provider 268 which for illustration is a gatekeeper 
268. The call request is routed at step 300 through 
network 274 and local area network 27 8 to gatekeeper 2 68 
which looks up the IP address of the caller's web server 
20 250 in lookup table 266 and retrieves caller identification 
such as the caller's name and phone number at step 302. It 
will be appreciated that in the embodiment shown, both the 
caller and the called party are subscribers to the same 
service provided by gatekeeper 268. In this case, user 
25 profiles for both the caller and called party, and IP 
addresses for their respective web servers and terminals, 
are stored locally within memory in gatekeeper 268. 

At step 304, gatekeeper 268 retrieves the IP 
30 address of the called party's web server 256 from either a 
lookup table or from the called party's user profile within 
user profile database 264. Messaging server 262 is 
programmed to encode the called party's web server IP 
address, the caller's web server IP address, and the caller 
3 5 information into a web message such as an HTTP message 
which server 262 generates at step 306. Preferably, the 
HTTP message is generated as illustrated in FIG. 15, and 
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includes instructions initiating operations by the called 
party's web server 256. For instance, in the preferred 
embodiment in FIG. 12, the HTTP message includes the 
location of a common gateway interface (CGI) script 
5 residing on the called party's web server, with the caller 
information and the caller's web server IP address serving 
as query parameters for use by the CGI script when it is 
executed. 

Once the HTTP message is generated, gatekeeper 
268 sends the HTTP message to the called party's web server 
256 where the message is executed, launching the called 
party's CGI script at step 308. The called party's CGI 
script includes codes instructing the called party's web 
server 256 to look up the local LAN IP address for the 
called party's terminal 16 via a local database. As a 
variation, the called party's web server 256 may be located 
on the called party's terminal 16, in which case the called 
party's web server 2 56 would preferably be accessed via the 
same IP address as the called party's terminal. 
Advantageously, for systems in which all terminals are 
provisioned with their own web server, the gatekeeper can 
look up the IP address of the called party's terminal and 
bypass the step of looking up the called party's web server 
IP address. 

At step 310, the called party's CGI script 
instructs the called party's web server 256 to send, using 
TCP/IP, the caller information received from the HTTP 
30 message to the IP address of terminal 16. Preferably, when 
terminal 16 is notified of an arriving call .at step 312, 
messaging software residing on terminal 16 displays the 
received caller information while retrieval of the caller's 
graphical information is processed. Retrieval of the 
35 additional caller information, including graphical 
information associated with the caller, is initiated at 
step 314 wherein the TCP/IP message from step 310 instructs 
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the terminal messaging software or a web browser residing 
on terminal 16 to send an HTTP message or other firewall 
friendly message (such as FTP, gopher or the like) to the 
caller's web server 250 so as to initiate a CGI script 252 
5 on web server 250. In a fashion similar to CGI script 258, 
upon receipt by the caller's web server 250 of the HTTP 
message from terminal 16, CGI script 252 is executed with 
parameters from the received HTTP message wherein the 
parameters identify requested caller information such as 
10 graphical image data 254. The requested caller 

information, including graphical image data 254, is 
retrieved by web server 2 50 under the handling of CGI 
script 252 at step 314 and transmitted back to terminal 16 
Iq as an HTTP message where it is parsed and the graphical 

rU 15 image data associated with the caller is presented to 
terminal 16 for display on the associated display device. 
Thereafter, the call between caller and called party 
f,l proceeds to completion with the called party having 

n available on terminal 16 both caller line identification 

j" 2 0 information and a digital representation of at least one 
jij graphical image associated with the caller. 

In the latter embodiment, graphical information 
and other information associated with the caller is 

25 retrieved and presented to the called party. As in the 
aforementioned embodiment shown in FIG. 8 for graphical 
message waiting notification, however, graphical 
information and other subscriber information pertaining to 
the called party may be retrieved and presented to the 

30 caller at the time the caller initiates a call. Such 
called party information may be in a business card- like 
format and stored as web pages or documents as previously 
discussed above . 



35 



By way of example, in FIG. 12 and 13, a caller 
initiating a call at step 300 may be a subscriber to such 
a service, in which case messaging server 262 may 
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automatically initiate retrieval of the called party's 
graphical information from the appropriate networked 
resource upon receiving the call request from the caller. 
Preferably, once the called party's web server IP address 
5 is identified in step 304, an HTTP message may be sent to 
the called party's web server initiating a CGI script coded 
to direct the called party' s web server to present to the 
caller's web server the appropriate graphical information 
associated with the called party. 

10 

As another variation, a call to the called party 
terminal 14 may be paused temporarily at gatekeeper 268 
which initiates retrieval of the graphical image data 
associated with the caller in the aforementioned manner 

15 with the transmission of an HTTP transmission to CGI script 
258. Once the caller graphical image data is delivered to 
terminal 16, the call setup may be allowed to proceed by 
gatekeeper 268 upon receipt by gatekeeper 2 68 of 
instructions to proceed from terminal 16. Advantageously, 

20 this embodiment offers a called party with visual call 
screening. In this variation, preferably the call times 
out in the event gatekeeper 2 68 does not receive 
instructions to terminate or process the call within a 
predetermined period of time. 

25 

In one variation, a subscriber terminal may 
include an interactive graphical activation software 
mechanism for directing the terminal to instruct the 
messaging server 262 to activate or deactivate graphical 

30 identification of the associated subscriber. 
Advantageously, this activation/deactivation feature has 
application both for calls as well as message recording. 
When deactivating graphical identification, the 
subscriber's terminal can be programmed to instruct 

35 messaging server 262 to deactivate the subscriber's 
graphical ID feature for a particular communication, for a 
particular recipient or until the messaging server 262 
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receives a activation signal from the subscriber' s 
terminal . 



In another variation of the embodiment shown in 
5 FIG. 12, messaging server 262 may provide a subscriber with 
the ability to pre-select particular graphical images for 
presentation to another subscriber during a communication 
depending upon the purpose or recipient of the 
communication. For instance, a subscriber may, via the 

10 subscriber's terminal device, pre-select a graphical 
picture of a monogrammed golf ball for communications with 
other subscribers about golf. Alternatively, a subscriber 
may pre-select another graphical picture to present during 
communications with specific other subscribers, such as 

15 family members or business colleagues. The selection of a 
graphical image may be performed by the subscriber' s 
terminal explicitly with each communication, or may be set 
by default for all communications or for specific classes 
of communications or subscribers. For instance, a 

20 subscriber's terminal may include selection software which 
directs the subscriber's terminal, in response to user 
input, to reference graphical images associated with the 
subscriber to particular recipients stored in the 
subscriber's personal directory located on the terminal or 

25 on an accessible network resource. It will be appreciated, 
as with other variations herein, that the ability to pre- 
select or pre-assign subscriber-related graphical images 
for presentation in a communication also has application in 
graphical message waiting notification. Furthermore, as 

30 is the case with the calling party, the called party may 
also choose the particular graphical image to be presented 
to incoming callers either by default (for instance, for 
callers whom are not pre-assigned for presentation a 
graphical image associated with the called party) , or by 

35 specific pre-association of called party graphical images 
with known callers stored in data files in the called 
party's personal directory. 
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In order to reduce delays in transactions, proxy- 
servers 270 and 272 may be provided as network resources so 
as to each cache web page information concerning the called 
party web server 256 and the caller's web server 250, 
5 respectively. Moreover, lookup table information may be 
cached locally within a called party's messaging domain 
such as at the called party's messaging server or the 
called party's web server and may be flushed periodically 
or if the cached lookup table information generates 

10 erroneous IP addresses or phone numbers (as the case may 
be) . Furthermore, in Intranet and similar networks, call 
transactions may be performed via a single web server over 
the network which acts as the web server for both callers 
and called parties. Providing for a single web server 

15 eliminates the multiple network transactions which would 
otherwise be necessary between web servers as illustrated 
the description with respect to FIG. 12 above. 

In yet another variation, preferably the CGI 
20 scripts residing on caller and called party web servers 
adhere to a standardized naming convention for ease of 
implementation. In another variation, rather than handling 
communication between called party's terminal 16 and 
caller's web server 250 using HTTP, communication is 

2 5 handled according to FTP or the like and requested caller 

information including graphical information from caller's 
web server 250 is delivered to terminal 16 as data files 
which are stored in RAM or permanent storage in terminal 
16. 

30 

Referring to FIG. 17, there is shown another 
illustrative network architecture for use with the 
graphical caller identification system shown in FIG. 12. 
In FIG. 17, caller and called party are subscribers to 

3 5 separate messaging domains interconnected directly or via 

networks or subnetworks. In this case, a caller initiates 
a call from a PSTN connected telephone or from a networked 
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phone or computer connected to the caller's central office 
267. The initiated call is received by the caller's 
central office or PBX wherein the switching equipment 
thereof looks up the IP address of the called party' s web 
5 server 256 as well as the IP address of the caller's web 
server 250. Preferably, the central office or PBX includes 
a computer server operative to generate an HTTP message 
addressed to the called party's web server 256 and 
including a call to CGI script 258 with parameters passing 

10 to the CGI script the IP address of the caller's web server 
250 and caller information such as caller line ID 
information retrieved by the caller's local central office 
or PBX. The HTTP message is sent by the central office or 
PBX to the called party's web server 256 wherein the CGI 

15 script 258 referenced in the HTTP message is executed with 
the passed-in parameters included in the HTTP message. 
Processing then proceeds as described above with reference 
to FIG. 12. In another alternative, the caller's call may 
be passed over a PSTN network by the caller's local central 

20 office or PBX to the called party's central office or PBX. 
In this latter case, the called party's central office or 
PBX switching equipment looks up the IP address of the 
calling party's web server 256 and sends the HTTP message 
to web server 256. 

25 

In another variation, the web server 
architectures described above in respect of FIG. 12 to 17 
may also be implemented in the context of graphical message 
waiting notification described in respect of FIG. 1 to 11. 

3 0 Advantageously, the same message handling techniques may be 
used with the same or similar CGI scripts. If, for 
instance, a call directed to terminal 16 in FIG. 12 does 
not connect, CGI script 258 directs the called party's web 
server 256 to pass a message to the messaging server 262 

35 containing the URL of the caller's web server 250 and the 
caller ID. Upon receiving the message from web server 2 56, 
messaging server 262 requests from the caller's web server 
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250 the graphical and textual information associated with 
the caller if such information is not already available. 
Graphical and textual information associated with the 
caller and received from the caller's web server 250 is 
5 stored as a graphical notification in the called party 
directory on a web server local to network 278. 
Preferably, such graphical notifications are stored with 
unique names so that the name of a graphical notification 
may be used to correlate the graphical notification with 

10 the appropriate stored message. Stored messages are 
preferably stored on a storage device connected to 
messaging server 262 for retrieval by the called party's 
terminal 16 . Terminal 16 may retrieve pending graphical 
notifications from the called party directory on the local 

15 web server (eg. called party web server 256) and requests 
for stored messages may be initiated using the CGI script 
of such a web server to initiate retrieval of selected 
messages from the message server 262 . 

2 0 In yet another variation, graphical message 

notification and graphical source and addressee 
identification services may be used with the Analog Display 
Services Interface (ADSI) protocol. For instance, an ADSI 
server may be connected to a central office associated with 

25 a voice messaging server. At the direction of the voice 
messaging server, the ADSI server may instruct the central 
office to send a message to the residential ADSI phone 
containing message waiting notification information 
including graphical information associated with the source 

30 of an incoming message. The called party's ADSI phone 
receives the graphical notification associated with the 
source of the incoming message and displays the information 
on a built-in display screen. 

35 Although this invention has been described with 

reference to illustrative embodiments which are merely 
illustrative of a preferred embodiment of carrying out the 
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invention, this description is not intended to be construed 
in a limiting sense. Various modifications of form, 
arrangement of parts, steps, details and order of operation 
of the illustrative embodiments, as well as other 
5 embodiments of the invention, will be apparent to persons 
skilled in the art upon reference to this description. For 
instance, the functionality provided by CGI scripts in the 
proceeding examples may also be provided by other 
mechanisms, such as Java Servlets, Server Side Includes 
10 (SSI) and other types of programs that can be invoked via 
command from a network. It is therefore contemplated that 
the appended claims will cover such modifications and 
embodiments as fall within the true scope of the invention. 
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